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(54) INFORMATION 
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(57) Abstract: 

PROBLEM TO BE SOLVED: To 
provide a display device through 
which sign language interpretation or 
character services can be provided all 
the time even if these services are not 
available on a transmission side. 

SOLUTION: An audio signal is led 
out of the audio output terminal of 
TV1 and inputted to a head mounted 
display dpvice(HMD) 4 through a 
communication cable3._The.HMD 4 
is equipped with a speech recognition 
part, an image generation part, a 
display unit, etc., and determines the 
language of the inputted audio signal 
by speech recognition and generates a 
sign finger image, etc., based upon 
the language. The generated sign 
finger image, etc., is projected on a 
combiner 5 by the display unit and a 
TV viewer can see the sign finger 
image, etc., over the TV image on the 
TV screen. 
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Epitome 

(57) [Abstract] 

[Technical problem] Even if there is no service of sign-language 
interpreting or an alphabetic character in a transmitting side, the 
information display which can always receive the same service is offered. 
[Means for Solution] A sound signal is taken out from the voice output 
terminal of TV1, and the signal is incorporated to HMD4 with a 
telecommunication cable 3. HMD4 is equipped with the speech recognition 
section, the image generation section, a drop, etc. , and speech 
recognition of the incorporated sound signal is carried out, it opts for 
language, and a sign language image etc. is created with the language. 
The created sign language image can be copied out on a combiner 5 with 
an indicator, and a viewer can regard a sign language image etc. as TV 
image of TV screen in piles. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The information display which consists of a receiving means 
receive the sound signal of television, video, and radios, a speech 
recognition means to recognize the received sound signal, an image 
creation means to create an image based on the this recognized voice, 
and a pocket mold display means to display the this created image. 



[Claim 2] The information display according to claim 1 which comes to 
have the drop equipped with the screen as which a pocket mold display 
means displays a generation image, the optical member which floodlights 
the image display light which carried out outgoing radiation from this 
drop in the predetermined direction, and the combiner which makes the 
light from a drop reflect or diffract while being allotted ahead 
[ viewer visual field ] and making the light from the external world 
penetrate. 

[Claim 3] The information display according to claim 1 or 2 whose image 
of an image creation means is sign language or an alphabetic character 
image. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of. the Invention] This invention relates to television, video, 
and the information display that displays the sound signal of radios as 
sign language or alphabetic character images. 
[0002] 

[Description of the Prior Art] In order that hearing current voice from 
a lug may make a difficult hearing-impaired person recognize voice, sucl 
as television, the program which performs sign-language interpreting or 
a teletext has been increasing. As for sign-language interpreting or an 
alphabetic character, it is common to carry out by making a sign- 
language interpreting person appear in some screens in a transmitting 
side, or displaying an alphabetic character here. 
[0003] 

[Problem (s) to be Solved by the Invention] However, by the conventional 



technique, if sign-language interpreting or an alphabetic character was 
not transmitted in the transmitting side, the hearing-impaired person 
was not able to receive the service. And the program which performs 
sign-language interpreting or a teletext as the present condition is 
restricted, and the amount of services can also be referred to as few. 
Although recognizing a sound from a motion of a performer' s opening was 
also considered, the motion of opening had individual difference and, 
moreover, a performer' s image was an impossible thing **** in the radio 
broadcasting which is not. 

[0004] Then, this invention aims at offering the information display 
which can always receive the same service, even if there is no service 
of sign-language interpreting or an alphabetic character in a 
transmitting side. 
[0005] 

[Means for Solving the Problem] This invention offers the information 
display which consists of a receiving means to receive the sound signal 
of television, video, and radios, a speech recognition means to 
recognize the received sound signal, an image creation means to create 
an image based on the this recognized voice, and a pocket mold display 
means to display the this created image in order to solve the above- 
mentioned technical problem. 

[0006] Here, television, video, and radios are all the audios that utter 
a sound signal, and the semantics containing video equipment (AV 
equipment). Although a sound signal receiving means can consider what 
connects a code to voice output terminals, such as television, and 
receives, the thing which collects voice, such as television, by the 
loudspeaker, the thing which receives direct sound voice from an antenna, 
it is not limited to these. 

[0007] what changes the sound signal with which the speech-recognition 
means was incorporated per language — it is — for example, the vowel 
recognition section and a consonant — after consisting of the 
recognition section, a recognition dictionary, and the language- 
processing section, recognizing a vowel based on the incorporated voice, 
generating an assumption based on this recognition result further and 
asking for the frequency of a consonant for every assumption, the 
optimal assumption determines based on each of these frequency, and it 
opts for language. In addition, a speech recognition means is not 
limited to this, but every well-known means can be used for it. When 
creating for example, a sign language image, the image creation means 
memorizes the sign language pattern, and generates a sign language image 
as compared with the language for which it opted with the speech 



recognition means. Moreover, the language for which it opted with the 
speech recognition means in the case of the alphabetic character image 
is changed into a picture signal as it is. 

[0008] The drop equipped with the screen as which a head wearing mold 
display (HMD) can be used, for example, and a pocket mold display means 
displays a generation image in that case as a pocket mold display means, 
It comes to have the optical member which floodlights the image display 
light which carried out outgoing radiation from this drop in the 
predetermined direction, and the combiner which makes the light from a 
drop reflect or diffract while being allotted ahead [ viewer visual 
field ] and making the light from the external world penetrate. 
[0009] Here, when a CRT display, a liquid crystal display, a plasma 
display, etc. can be used, for example and it uses a liquid crystal 
display as an indicator, a back light can use a halogen ball, a cold 
cathode tube, and LED. Well-known things, such as a concavo-convex lens 
and a mirror, can be used for an optical member. Moreover, if the light 
from a drop is deflected in the direction which a viewer can check by 
looking while a combiner makes the light from the external world 
penetrate, anything, it is good and a holographic combiner etc. can be 
used for it. 
[0010] 

[Embodiment of the Invention] The example of this invention is explained 
based on a drawing. The schematic diagram when using the equipment of 
this invention for drawing 1 , and watching television (it being called 
Following TV) is shown. A viewer is located in the location to which TV 
of 1 is visible to and TV screen of 2 is visible on TV screen in drawing 
1 . The viewer has attached HMD (head wearing mold display) 4. HMD4 
mainly consists of control systems, such as a combiner 5, an indicator 
mentioned later, and the speech recognition section, the image 
generation section, a head applied part 6, and a telecommunication cable 
3, and a telecommunication cable 3 is connected to the voice output 
terminal (not shown) of TV1. The head applied part 6 is carrying out the 
configuration similar to the hook section of glasses, and a viewer can 
TV see [ 2 ] through the combiner 5 of HMD4 allotted ahead [ visual 
field ] by equipping with it. 

[0011] In addition, the drop etc. is laid underground in the head 
applied part 6, and the structure is shown in drawing 2 . That is, a 
drop reflects the information-display light L from the information- 
display section and the information-display section which consists of a 
liquid crystal display panel Dl of a transparency mold, and the light 
source D2 arranged in the tooth back by the combiner 5, and consists of 



an optical member A for making Viewer P reach. In addition, the optical 
member A consists of a lens system Al, mirror A3, and a convex lens A2, 
and a combiner 5 reflects the light from a drop while making the light 
from the external world penetrate. Moreover, by the display-control 
circuit, the liquid crystal display panel Dl outputs a status signal to 
a LCD driver, and drives it according to the status signal inputted into 
the LCD driver. 

[0012] Signal transduction to a display-control circuit is performed by 
the approach shown in drawing 3 . That is, the sound signal of TV1 is 
first incorporated with a telecommunication cable 3 by the speech 
recognition section in HMD4. the speech recognition section — the vowel 
recognition section and a consonant — after consisting of the 
recognition section, a recognition dictionary, and the language- 
processing section, recognizing a vowel based on the incorporated voice, 
generating an assumption based on this recognition result further and 
asking for the frequency of a consonant for every assumption, the 
optimal assumption is determined based on each of these frequency, and 
it opts for language. The language for which it opted is sent to the 
image creation section. In the image creation section, the sign language 
pattern is memorized beforehand and a sign language image is generated 
as compared with the language for which it opted with the speech 
recognition means. The signal according to the generated sign language 
image is sent to a display-control circuit, and a status signal occurs. 
The status signal of a display-control circuit is outputted to a LCD 
driver, and a liquid crystal display panel is driven according to the 
status signal inputted into the LCD driver. Thereby, a sign language 
image copies out before a viewer' s face. 

[0013] By the above configuration, as shown in drawing 1 , a viewer will 
equip a head with HMD4, the TV screen 2 will only be seen, and a sign 
language image can be seen in piles by TV image. Drawing 4 showed how TV 
image would appear from a viewer. The sign language image has appeared 
in the part under TV image. In addition, the location where this sign 
language image appears can be easily changed by changing the directions 
(location of a combiner etc. ) where a viewer equips with HMD4. Moreover, 
a display position can be changed even if it changes the optical member 
in HMD4. 

[0014] Furthermore, although the above explanation explained displaying 
a sign language image, an alphabetic character image may be expressed. 
In this case, what is necessary is just to change into a picture signal 
the language for which it opted in the speech recognition section as it 
is. Moreover, it not only displays the voice of TV as a sign language 




image etc. , but if the telecommunication cable 3 of HMD4 is connected to 
voice output terminals, such as radio and video, it can obtain the same 
image. 
[0015] 

[Effect of the Invention] According to this invention, even if a 
transmitting side does not serve sign language, an alphabetic character, 
etc. , the same service can be easily received only by equipping a head 
with' HMD. Moreover, in displaying information, such as sign language and 
an alphabetic character, on HMD, modification of the display position 
becomes easy. Furthermore, since HMD carries and is easy, a location etc. 
will not be asked but the service same anywhere always can receive. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing l] The schematic diagram when seeing TV using the equipment of 
this invention 

[Drawing 2] The schematic diagram of a drop internal structure 
[Drawing 3] The schematic diagram for incorporating and displaying the 
voice of TV on HMD 

[Drawing 4] Drawing which displayed the sign language image on TV image 
in piles 

[Description of Notations] 
1 — TV 2 — TV screen 

3 — Telecommunication cable 5 — Combiner 
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[Drawing 1] 
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